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I. Field of the Invention 

The present invention relates to both convolutional 
decoding and to turbo decoding for communications applications 
and in particular to mobile, point-to-point and satellite 
communication networks, CDMA (Code Division Multiple Access) and 
OFDMA (Orthogonal Frequency Division Multiple Access) cellular 
telephone and wireless data communications with data rates to 
multiple Tl (1.544 Mbps) and higher (>100 Mbps) , and to optical 
WDMA (Wavelength Division Multiple Access) links with data rates 
to >100 GBps (Gega bit per second) and higher ranges. More 
specifically the present invention relates to novel a-posteriori 
probabilities and decisioning metric paradigms and architectures 
which reduce the number of arithmetic multiply operations and 
thereby reduce the computational complexity, improve iterative 
convergence thereby reducing complexity, improve bit error rate 
(BER) performance, and provide new metric processing algorithms 
to support the various decoding algorithms. 

II. Description of the Related Art 

Current art is represented by the recent IEEE publication 
in reference [1] which summarizes the theorectical and 
applications work on turbo codes, books on turbo codes in 
references [2] , [3] , [4] , [5] , [6] , [7] , [8] and. the reference text on 
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the theorectical foundations of probability and decisioning 
metrics [9]. In addition there are the fundamental patents on 
turbo decoding. 



5 Maximum likelihood ML decisioning metrics DM are currently 

used in turbo and convolutional decoding wherein DM is the 
natural logarithm of the ML probability which is the conditional 
Gaussian probability of the observed communications channel 
output symbol y assuming that the transmitted symbol is x. This 
10 defines the decisioning metric DM in equations (1) where In is 
the natural logarithm and log is the logarithm. Reference to log 
is understood to mean the natural logarithm since it is always 



15 Decisioning metric DM (1) 

1 ML probability p(y|x) is the Gaussian conditional 
probability 

p(y|x) = exp(-|y-x| 2 /2a 2 ) / (2n) 1/2 a 

20 2 Log of the ML 

ln[p(y|x)] = -|y-x| 2 /2a 2 -In [ (2n) 1/2 a] 

3 Decisioning metric DM is the log 

of the ML probability with the additive constant term 
25 removed 

DM(y,x) = -|y-x| 2 /2a 2 
wherein the constant l/2a 2 scales the DM relative 
to the noise floor 2a 2 of the symbol detector 
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used in turbo decoding and in convolutional decoding. Step 1 is 
the definition of the zero-mean conditional Gaussian probability 
density function. Step 2 is the log. Step 3 is the decisioning 
metric DM that measures the distance between y and x, where o is 
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the one sigma value of the inphase and the quadrature noise. This 
DM metric is used in the convolutional decoding algorithm, and in 
the turbo decoding algorithm when combined with the a-priori 
probability of the correct decoding bit. The DM metric is a ML 
5 distance metric and the functional form is determined by the 
zero-mean Gaussian assumption for the link and receiver 
processing noise. 

Maximum a-powteriori probability MAP turbo decoding starts 
10 with a sequence of observed channel output symbols {y(k), 
k-l,2,...,N} of the receiver where k is the running index over the 
N transmitted symbols. 

FIG. 1 is a representative turbo encoder block diagram for 
15 a parallel architecture. Input 1 to the encoder are the user data 
bits {d(k)} for k=l,2,. . .,N. The encoder for a turbo code uses 
a recursive systematic code RSC which means the first codeword 
bit 2 is the user data bit called systematic bit, or bits, which 
are uncoded. These user data bits {d(k)} are also handed over 
20 to the first RSC encoder 3 called #1 encoder, and after 
interleaving 4 are also handed over to the second RSC encoder 5 
called #2 encoder. User data bits and the encoder output bits 
are punctured 6 to obtain the correct code rate and then 
multiplexed into a continuous output bit stream 7 of codewords 

25 {c(k)} for each of the codeword clocks k=l,2, ,N. Each 

codeword c(k) is a set of bits consisting of the systematic bits, 
#1 encoder output bits, and #2 encoder output bits. 

FIG. 2 is a representative transmitter block diagram for 
30 implementation of both the turbo encoder in FIG. 1 and the 
convolutional encoder in FIG. 7. Signal processing starts with 
the input stream {d(k)} of user data bits 8 to the 
convolutional/turbo encoder 9. Output 10 of the 
convolutional/turbo encoder in FIG. 1 are the stream of codewords 
35 {c(k)} handed over to the frame processor. Frame processor 11 
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accepts these codewords and performs error detecting coding such 
as a CRC (cyclic redundant code) and frame formatting, and 
passes the outputs to the symbol encoder 12 which encodes the 
data onto amplitude and phase with possible frequency and time 
5 assignments and whose outputs are the transmitter symbols {x(k)} 
corresponding to the codewords of the convolutional/turbo encoder 
output as well as the other symbols for the frame data including 
the CRC. Framing can be done before and/or after the turbo 
encoding. Transmitter symbols {x(k)} are modulated 13 into a 
10 waveform. Modulator output signals for multiple channels are 
multiple-access processed and combined 14 for handover 14 as a 
stream of complex baseband digital signal samples {z(ti)} where t± 
is a time index, to the digital-to-analog conversion processing 

15 which converts the complex baseband input signal from the 
15 multiple access processing into a single sideband SSB upconverted 

real signal v(t) 15 at an intermediate frequency IF where 
{z(ti)} is the stream of complex baseband signal input samples 
at the digital times {ti} to the digital-to-analog conversion. 
The digital-to-analog processing also includes beam forming 

20 calculations for both digital and analog beam- forming antennas. 
Multiple access examples in 14 are time division multiple 
access TDMA, frequency division FDMA, code division CDMA, space 
division SDMA, frequency hop multiple access FHMA, and all 
combinations of these and others not mentioned but inferred from 

25 this representative list. 

For multiple beam antennas 16 in FIG. 2 the beam 
coefficients for each beam element for each complex digital 
sample are processed 15 and the individual digital streams are 
30 handed off to the corresponding antenna elements where they are 
SSB upconverted to an IF and processed by the analog front end 

16 at each element and the array of elements form the beams and 
within each beam the transmitted signal is similar to the real RF 
signal v(t) in 17 for a single beam. For single beams the 

35 analog front end 16 upconverts and amplifies this IF signal and 
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transmits it as the real RF signal v(t) 17. This real waveform 
v(t) 17 is at the RF carrier frequency f 0 and is the real part 
of the complex envelope of the baseband, waveform z(t) multiplied 
by the RF carrier with the phase angle which accounts for the 
5 phase change from the baseband signal to the transmitted signal. 

MAP (maximum a-posteriori probability) joint probability 
used in the MAP turbo decoding algorithm is defined in equations 
(2) which are taken from references [1],[2]. Definition 1 
10 introduces common terminology in 



MAP joint probability for turbo decoding (2) 
1 Definitions 

15 S(k) = Decoder trellis state at clock k 

= Decoder shift register state at clock k 
k = Index of received codewords 

= trellis decoder states 
= decoding clock 
20 s',s = Values of S(k-l), S(k) respectively 

y = Set of observed channel output symbols 

= {y(k), k=l,2,...,N} 
RSC = Recursive systematic code 

= Systematic code SC with feedback which is a 
25 requirement for turbo decoding 

Parallel encoding = Encoding configuration for turbo 
decoding which transmits the symbols using a 
parallel architecture, which is the assumed 
architecture for this invention disclosure 
30 y(k) Output symbols for codeword/clock k 

{y(j<k)} = Output symbols for clocks j=l, 2, k-1 
{y(j>k)} = Output symbols for clocks j=k+l, , 2, ...,N 
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2 Decoding states and observations 

Observations are the set {y(k), k=l , 2, N) 

, z 

5 1 k = 1,2,...,N N 

Subsets y ( j<k) , y (k) , y ( j>k) of y are of interest 

| | •») 

k-1 k k+1 \ N 

10 y(j<k) y(k) y(j>k) 



Decoder trellis states of interest are s',s 
, -»| | , 

15 k-1 k k+1 n 

/ \ 

S(k-l)=s' S(k)=s 



20 3 MAP joint probability 

The joint probability of interest for MAP is 
p(s',s,y) = p(s',s, y(j<k) ,y(k) , y(j>k) ) 



25 turbo decoding literature. In 2 the decoding states s',s are 

defined at clocks k-l,k and the observations are defined over the 
j=l, 2, k-1 as y(j<k), over j=k+l,... f N as y(j>k), and at k as 
y(k). In 3 the MAP joint probability is defined as a function of 
these decoder states and observations. 

30 

Recursive equation for the MAP joint probability is derived 
in equations (3) by reformulating the joint probability equation 
in 3 in equations (2) as a function of the recursive, state 
estimators a,p and the state transition probability y. Step 1 
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is the application of Bayes rule to partition the joint 
probability. Step 2 takes advantage of the assumption that the 



5 Recursive formulation of MAP joint probability (3) 

1 Bayes theorem or rule p (a,b) =p (a | b) p (b) can be used to 
rewrite the MAP joint probability in 3 in equation (2) 

p(s',s,y) =p(s',s, y (j<k) , y (k) , y (j>k) 
= P(y(j>k) |s',s, y(j<k),y(k)) 
10 *p(s', S/ y(j<k),y(k))) 

where u *" is a multiply operation 

2 Assuming the channel is memoryless 

p(s',s,y) =p(y(j>k)is) p(s' ,s, y(j<k),y(k)) 

15 

3 Re-applying Bayes rule and the assumption that 
the channel is memoryless 

p(s',s,y) =p(y(j>k)|s) p(s,y(k)|s') p(s',y(j<k)) 

20 4 This equation can be rewritten as a function of the 

recursive estimators and state transition probability 

p(s,s',y)= p k (s) y k (s,s') etuis') 
where by definition 

Pk(s) = p(y(j>k) |s) 
25 y k (s,s') = p(s,y(k) |s') 

a k _!(s' ) = p(s' ,y(j<k) ) 



channel is memoryless to simplify the partitioning in step 1. 
30 . Step 3 re-applies the Bayes rule and the memoryless assumption to 
re-partition the equation and simplify it to the final form used 
in the MAP algorithm. Step 4 transforms the joint probability in 
step 3 derived as a product of three probabilities, into the 
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equivalent product of the two estimators a^fs' ) ,p k (s) and the 
state transition probability y k (s,s')for the MAP algorithm. 

Forward recursive equation for the state estimator <x k (s) is 
derived in equations (4) as a forward recursion which is a 
function of y k (s,s') and the previous estimate a k -i(s f ). Step 1 
starts with the definition of a k (s) which is derived from the 
equation for a k -i(s') in 4 in equations (3), Step 2 introduces 
the state s' by observing that the probability summed over all 
values of s' is equal to the probability with s' excluded. Step 3 
applies Bayes rule to partition the probabilities. In step 4 the 
assumption that the channel is memoryless enables the equation to 
be simplified to the form used 

Forward recursive equation for <x k (s) (4) 

1 Definition of a k _i(s') in 4 in equations (3) gives 

<x k (s) .= p(s, y( j<k) ,y (k) ) 

2 This probability can be written as the sum of 
joint probabilities over all possible states of s' 
<x k (s) = Zaii s' p(s,s',y(j<k) ,y(k) ) 

3 Applying Bayes rule 

a k (s) =Zai ls < p(s,y(k) |s',y(j<k))p(s',y(j<k) ) 

4 Applying the channel memoryless assumption 
a k (s) = Ian S ' p(s,y(k) I s' ) P (s' ,y ( j<k) ) 

5 Substituting the definitions of y k (s,s') and 
ot k -i(s') from 4 in equations (3) 

a k (s) = Zaii s' y k (s,s') a k _i(s') 
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in the MAP algorithm. In step 5, substitution of y k (s,s') and 
otk-i(s') from 4 in equations (3) gives the final form for the 
recursive equation for <x k (s) . 

5 

Backward recursive equation for the state estimator p k -i(s') 
is derived as a backward recursion in equations (5) as a 
function of the y k (s,s') and the previous estimate p k (s), 
following the steps in equations (4). Step 1 derives p k -i(s') 
10 from the equation for p k (s) in 4 in equations (3). Step 2 
follows steps 2,3,4 in the derivation of a k (s) in equations (4). 



Backward recursion equation for p k -i(s') (5) 
15 1 The definition for p k (s) from 4 in equations (3) 

p k -i(s') = p(y(j>k-l) Is') 

2 Following steps similar to steps 2,3,4 in equations (4) 

Pk-i(s') = Zaii s P(y(j>k) |s)p(s,y(k) |s') 

20 

3 Substituting the definitions of y k (s,s') and 
P k (s) from 4 in equations (3) 

Px-i(s') = Zaii s Pk(s) y k (s,s') 

25 

In step 3, substitution y k (s,s') and p k (s) from 4 in equations 
(3) gives the final form for the recursive equation for p k -i(s'). 



State transition probability y k (s,s / ) and the log, ¥k(s,s') 
30 of y k (s,s') are derived in equations (6). The y k (s,s') is the 
probability of 
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State transition probabilities y k (s, s' ) , Xk (s, s' ) (6) 

1 From the definition of Yk(s f s f ) from 4 in 

equations (3) and Bayes rule 
5 y k (s,s') = p(s,y(k) Is') 

= p(y(k) |s,s') p(s|s') 

2 Define 

d(k) = input bit necessary to cause the 
10 transition from state S(k-l)=s' to S(k)=s 

p(d(k)) = a-priori probability of d(k) 
x(k) = transmitted codeword symbols defines the 
transition from S(k-l)=s' to S(k)=s 
= {x(k,b)) where b refers to the codeword bit 
15 y(k) = received codeword symbols for 

codeword/clock k 
= {y(k,b)} where b refers to the codeword bit 

3 With these definitions and the memoryless assumption, 
20 the Yk(s,s') equation in 1 becomes 

Yk(s,s') = p(y(k) |s,s' ) p(d(k)) 
= p(y(k) |x(k)) p(d(k)) 
= lib p(y(k,b) ^(k.b) ) p(d(k) ) 

25 4 Assume the channel is Gaussian and the symbols are BPSK 

Yk(s,s')=n b exp( -|y(k,b)-x(k,b) 1 2 /2<j 2 ) / (2*) 1/2 a 

* p(d(k)) 

5 The DM from 3 in equations (1) can be rewritten 
30 DM(s|s')=S b DM(y(k,b) ,x(k,b) ) 

= Z b -|y(k r b)-x(k r b) l 2 /2a 2 
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6 Log equation for y k (s,s') takes the log, 
uses DM, and deletes the additive constant 
X k (s,s') = DM(sls') + p(d(k)) 
wherein p (d (k) ) =log (p (d (k) ) ) 



the decoder trellis state S(k-l)=s' transitioning to the next 
state S(k)=s symbolically written as s'->s. Step 1 applies Bayes 
rule to the definition of y k (s,s') in 4 in equations (3). Step 2 

10 are definitions. Step 3 uses these definitions to transform the 
Yk(s,s') into the product of the conditional probabilities 
p(y(k)|x(k)) of the received codeword symbols {y(k)} given the 
transmitted codeword symbols {x(k)}, and the a-priori probability 
p(d(k)) causing this transition. The p(y(k)|x(k)) is the product 

15 over the bits b=l,2,... for the #1 or #2 encoders in FIG. 1 
depending on which is being addressed, of the probabilities for 
each bit p(y(x,b) |x(k,b) ) . 

Step 4 introduces the standard turbo code assumption that 
20 the channel is Gaussian and uses BPSK (Binary phase shift 
keying) symbols which means d(k)=+/-l when interpreted as a BPSK 
symbol, and a is the one sigma Gaussian inphase and quadrature 
noise. Step 5 observes that the DM metric is a function of the 
states s,s' which is equal to the sum of the DM metrics over the 
25 bits {b} of the codeword corresponding to the transition from 
S(k-l)=s' to S(k)= s. In step 6 the equation for the log, 
3k(s,s')/ of Yk(s,s') as a function of the DM metric and the log, 
p(d(k)), of p(d(k)) is used in turbo decoding algorithms, and in 
convolutional decoding algorithms when g(d(k)) is deleted. 



30 



Log equations for a^s), gk-i(s') are derived in equations 
(7) from equations (4) , (5) respectively for a k (s), p k -i(s') 
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using the definition of ¥ k (s,s') in 6 in equations (6). Step 1 
gives the log equation for a k (s) by taking the 



5 Log equations for a k (s) , |3 k _i(s') (7) 

1 Log, a k (s) , of a k (s) 

a k (s) = ln[£aiis' exptOk-iCs' )+DM(s|s' )+ £(d(k))] 

2 Log, &-i(s'), of p k -i(s') 

10 fik-i(s')= ln[ lansexp ( g k (s)+DM(s|s') + p(d(k))] 

log of the a k (s) equation in 5 in equations (4) and using the 
definition of }[ k (s,s') in 6 in equations (6). Step 2 takes the 
15 log of the equation for p k ~i(s') in 3 in equations (5) to derive 
the log equation for J3 k _i(s') and uses the same definition for 
Zk(s,s' ) . 

MAP equations for the log likelihood ratio L(d(k)|y)) are 
20 derived in equations (8) . Step 1 is the definiton from references 
[1],[2]. Step 2 uses the Bayes rule P (a,b) =P (a |b) P (b) with the 
p(y) cancelled in the division. Step 3 replaces p(d(k)) with the 



25 MAP equations (8) 

1 Definition 

L(d(k) ) |y) = ln[ p(d(k)=+l|y) ] 
-ln[ p(d(k)=-l|y) ] 

30 2 Bayes rule allows this to be rewritten 

L(d(k) ) |y) = ln[ p(d(k)=+l,y)] 
-ln[ p(d(k)=-l,y) ] 
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3 Probability of p(d(k)) is the sum of the probabilities 
that the state S(k-l)=s' transitions to S(k)=s for the 
assumed values d(k)=+l and d(k)=-l 

L(d(k))|y) = ln[ Z i9 , a . | d <k)-+u P(s,s',y)] 
-ln[ 2( S ,s'id(k)=-i) p(s,s',y) ] 



4 MAP equation is obtained by substituting the 
fi k -i(s' ) /&(s) , &(s,s') into 3 
10 L(d(k))|y) = ln[ Z (SrSMd(k)SB+1) p(s,s',y)] 

-ln[ Z( SfS 'id(k)-ij P(s,s' ,y) ] 

= ln[Z< S/S ',d(k)= + i) exp(a k _i(s' )+DM(s|s' )+£(d(k) )+g k (s) ) ] 
-lnCZ^sHddc,-!, exptOk-its' )+DM(s|s f )+E(d(k) )+fi k (s) ) ] 
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5 Decide d(k) = +1 when L(d(k)|y) > 0 
= -1 when L(d(k) | y) < 0 



. 20 

equivalent sum of the probabilities that the transition from 
S(k-l)=s' to S(k)=s occurs for d(k)=+l and for d(k)=-l. Step 4 
substitutes the log of the recursive estimators Ok-i (s' ) ,J3 k (s) / 
from 1,2 in equations (7) and the state transition probability 
25 Yk(s,s') from 6 in equations (6). In step 5 the hard decisioning 
rule is d(k)= +/-1 iff L(d(k)|y) >/< 0 and the soft decisioning 
metric is the value of L(d(k)|y). 

MAP turbo decoding iterative algorithm is defined in FIG. 3 
30 and in equations (9) for a parallel architecture using the MAP a- 
posteriori equation in equations (8) with BPSK (Binary Phase 
Shift Keying) modulation. This basic algorithm is used to 
illustrate how the decisioning metric DM is implemented, and is 
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representative of how the DM metric is used for the more 
efficient algorithms such as the Log-MAP, Max-Log-MAP, iterative 
SOVA , and others, for parallel and serial architectures and 
other variations, and for modulations other than BPSK. 

5 

FIG, 3 inputs are the detected soft output symbols 18 from 
the received channel demodulator which detects and recovers these 
symbols. This stream of output symbols consists of the outputs 
{y(k / b=l)} for the systematic bit b=l which is the uncoded bit, 

10 the subset of the output symbols from #1 encoder 3 in FIG. 1, and 
the remaining output symbols from #2 encoder 5 in FIG. 1. 
Systematic bits are routed to both #1 decoder 22 and #2 decoder 
25. Encoded bits from #1 and #2 encoders are separately routed 19 
to #1 and #2 decoders. The detailed decoding in FIG. 3 will be 

15 described in parallel with the MAP turbo decoding iterative 
algorithm in equations (9) . In equations (9) , step 1 defines the 
various parameters used in the turbo decoding iterations. 

Step 2 starts iteration i=l in FIG. 3 for #1 decoder 22. 

20 Extrinsic information L ie from this decoder 22 in FIG. 3 for i=l 
is calculated in step 2 in equations (9) using the soft outputs 
{y(k,b=l)} 20 of the received channel for the systematic bit b=l 
which is the uncoded bit, the subset of the detected output 
symbols 19 which are from #1 decoder 3 in FIG. 1, and the #1 

25 decoder likelihood ratio output L x calculated from 4 in equations 
8. The a-priori information on p(d(k)) in 4 in equations (8) 
from #2 decoder 25 is not available so p(d(k))=0 corresponding 
to p(d(k)=+l)=p(d(k)=-l) = 

30 

MAP turbo decoding iterative algorithm (9) 
Step 1 Definitions 

L ra = { L(d(k=l) |y) ) , k=l,2,....} for m=#l,#2 decoders 
= a-posteriori likelihood ratio 
35 Lme = { L me (d(k=l) |y) ) , k=l,2,....} 



= extrinsic information from m=#l,#2 decoder 
= a-priori estimates of In [p (d=+l) /p (d=-l) ] 

which defines £ for the other decoder using 

equations (10) to solve for p 

L le = Interleaved L le 

^2e ' L 2 = De-interleaved L 2e / L 2 
y(k / b=l) "= y for uncoded bit b=l 

y (k,b=l) = interleaved y for uncoded bit b=l 



Step 2 Iteration i=l starts the turbo decoding 
L le - Li - 0 - (2/o 2 )Re[y(k,b=l) ] 
L 2e = L 2 - L le - (2/o 2 )Re[ y (k,b=l) ] 
where Re(o) = Real (o) 

Step 3 For iteration i=2,3,... 

L le = Li - L 2e - (2/a 2 )Re[y (k f b=l) ] 

L 2e = L 2 - L le - (2/a 2 )Re[y (k f b=l) } 
Step 4 Decode after last iteration 

Decide d(k)=+l/-l s 1/0 bit value 
for L 2 (d(k) |y)>/<0 for k=l,2,. . . 

where d (k) is the estimate of d(k) from turbo 
decoding 



Step 2 next proceeds to #2 decoder 25. A-priori estimates 
for p(d(k)) are calculated from the extrinsic information from #1 
decoder after interleaving 23 in FIG. 3 in order to align the 
bits with the interleaved bits 4 in FIG. 1 which are encoded by 
the #2 encoder 5. Calculation of the a-priori £ for #1,#2 
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decoder using the extrinsic information from #2,#1 decoder is 
given in equations (10) from references [2] ,[4]. Inputs to the 

5 A-priori calculation of p in 4 in equations 8 (10) 

K = [1+ exp(L me )] 

E (d(k)= -1) = -ln(K) 

£(d(k)= +1) = L^-lrKK) 

10 

#2 decoder 25 in FIG. 3 are the detected output symbols 19 from 
the #2 encoder 5 in FIG. 1, the detected symbols for the 
systematic bits 21 after interleaving 24 , and the extrinsic 
information from #1 decoder 22 after interleaving 23. 
15 Calculation of the extrinsic information L 2e from #2 decoder is 
given in step 2 in equations (9) . 

Step 3 repeats step 2 with the subtraction of the de- 
interleaved 26 extrinsic information input L 2e to #1 decoder 22 

20 from #2 decoder 25. This L 2e is used to calculate the a-priori 
probabilities £ using equations (10) for use in the evaluation of 
the a-posterior likelihood ratio Li from decoder #1, and also 
used in the calculation of the ^extrinsic information L le for 
decoder #1 in step 3 in equations (9) . 

25 

Step 4 is the calculation of the estimates {d(k)} for the 
transmitted information {d(k)} in the form of +/-1 used in the 
iterative algorithm to model the BPSK modulation with values +/-1 

for the estimated input signal {d(k)} in 28 with +1 
30 corresponding to the bit value 1 and -1 for the bit value 0. The 

de-interleaved 27 a-posteriori maximum likelihood ratio L 2 from 
#2 decoder in FIG. 3 yields these output bits 28 using the hard 

16 



decisioning rule that decides 1/0 depending on whether the L 2 is 
>0 or <0. 

Convolutional decoding will be discussed in the disclosure 
5 of the new invention. 

FIG. 4 is a representative demodulation receiver block 
diagram for implementation of the turbo decoder in FIG. 3 and the 
convolutional decoder in FIG. 8, which emphasizes the 

10 demodulation processing for both single and multiple channels. 
The signal processing starts with the user transmitted wavefronts 
29 incident at the receiver antenna for the n u users u =1,..., n u < 
N c . These wavefronts are combined by addition in the antenna to 
form the receive Rx signal v(t) at the antenna output 30 where 

15 v(t) is an estimate of the transmitted signal v(t) 17 in FIG. 
2, that is received with errors in time At, frequency Af, phase 
AG, and with an estimate z(t) of the transmitted complex baseband 
signal z(t) 14 in FIG. 2. This received signal v(t) is 
amplified and downconverted by the analog front end 31 and then 

20 synchronized and analog-to-digital ADC converted 32. Outputs 
from the ADC are handed over to the multiple access channel 
recovery signal processing 33 and the demodulation processing 
34 where the waveform is removed to recover the symbols 35. These 
detected symbols 35 are turbo/convolutional decoded 36 to 

25 recover estimates { d(k) } of the received data which are processed 
by the frame processor 37 to recover estimates 38 of the 
transmitted user data words. The serial processing for the 
multiple access channel recovery and the demodulator is combined 
for several of the multiple access schemes and for the 

30 demodulation such as GMSK. As noted in the discussion for FIG. 2, 
the frame processing can be before and/or after the turbo 
decoder. 
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It should be obvious to anyone skilled in the 
communications art that this example implementation clearly 
defines the fundamental current turbo and convolutional encoding 
and decoding signal processing relevant to this invention 
5 disclosure and it is obvious that this example is representative 
of the other possible signal processing approaches. 

For cellular applications the transmitter description 
describes the turbo and convolutional encoding transmission 
10 signal processing applicable to this invention for both the hub 
and user terminals, and the receiver describes the corresponding 
turbo and convolutional decoding receiving signal processing for 
the hub and user terminals for applicability to this invention. 

15 For optical communications applications the microwave 

processing at the front end of both the transmitter and the 
receiver is replaced by the optical processing which performs the 
complex modulation for the optical laser transmission in the 
transmitter and which performs the optical laser receiving 

20 function of the microwave processing to recover the complex 
baseband received signal with the remainder of the signal 
processing functionally the same as described in FIG. 2 for the 
turbo and convolutional encoding transmitter and in FIG. 4 for 
the turbo and convolutional decoding receiver. 

25 



SUMMARY OF INVENTION 

30 This invention introduces a new decisioning metrics in this 

invention for turbo decoding and convolutional decoding, a new 
MAP joint probability for turbo decoding, a new formulation to 
replace the ML probability for convolutional decoding, and the 

18 



corresponding new estimators that replace the current recursive 
estimators a k _i,p k , and the new replacement for the state 
transition probability y k used for both convolutional and turbo 
decoding. It will be apparent to the reader that these 

5 probability equations together with the decisioning metrics 
provide new mathematical framework for the decoding algorithms, 
and offer an improvement in BER performance., rate of convergence 
for turbo decoding, and lower implementation complexities. 

10 The MAP joint probability for turbo decoding is p(s,s',y) 

defined in 3 in equations (2), where s,s' are the decoding 
states for symbol sets k,k-l respectively and y is the complete 
set of observed symbol sets for k=l,2,...,N. The current 
practice uses the p(s,s',y) in the MAP equations (8) wherein the 

15 MAP a-posteriori log likelihood ratio L(d(k) I y) in 3 in equations 
(8) reduces to the natural log of the ratio of the sum of 
p(s,s',y) over s,s' for d(k)=+l, to the sum of p(s,s',y) over 
s,s' for d(k)=-l. 

20 The MAP joint probability p(s,s',y) was formulated to 

support the use of the maximum likelihood ML probability p(y|x) 
in 1 in equations (1) and the corresponding log form of the ML 
decisioning metric DM in 3 in equations (1) , and to support the 
factoring into the product of the estimators a k _i,p k ,y k in 4 in 

25 equations (3) . This factoring in log form in 4 in equations (8) 
is equal to the sum of the log forms of these estimators a k - 
if&f¥k which are used for all of the turbo decoding algorithms, 
as well as for the covolutional decoding algorithms upon deleting 
the a-priori p in ^ in 6 in equations (6) . 

30 

ML maximizes p(y|x) with respect to x in order to find the 
best x which is equivalent to maximizing the decisioning metric 
DM in 3 in equations (1) equal to DM=- 1 y-x 1 2 /2<y 2 with respect to x 
where |y-x| is the geometric distance between x and y. This DM in 



3 in equations (1) is the natural log of p(y|x) with the additive 
constant removed. Maximizing DM is equivalent to minimizing |y-x| 
and therefore selects the x which is closest to y as the ML 
choice for x. ML decisioning metric DM is used to make the bit 
5 decisions in turbo decoding as demonstrated in equations 
(7) , (8) , (9) , and is used to select the best trellis paths in 
convolutional decoding as will be demonstrated in the disclosure 
of this invention. 

10 The new MAP probability p(s,s'|y) is the a-posteriori 

probability of s,s' given the observations y. This is the 
correct formulation for the MAP probability from a probability 
theorectic viewpoint Ref. [8], and is made possible by the use 
of the a-posteriori probability p(x|y) for the probability of the 

15 transmitted symbol x given the observed symbol y, in place of 
the ML p(y|x) in equations (1). It will be demonstrated that by 
using the new MX decisioning metric DX, the p(s / s / |y) in log 
form can be factored into the sum of the new recursive estimators 
which replace the a k -i,J3 k and the new state transition probability 

20 £ k that replaces & currently used for all of the turbo decoding 
algorithms, 

The new maximum a-posterior MX replaces the maximum 
likelihood ML, and maximizes the a-posteriori probability p(x|y) 

25 of x conditioned on the observation y, with respect to the 
selection of x. Maximizing p(x|y) is equivalent to maximizing 
the natural log of p(x|y) and yields the new decisioning metric 
DX=Re (yx* ) /a 2 - I x 1 2 /2a 2 +p (x) wherein jd(x) is the natural log of 
p(x), Re(o) is the real part of (o) , and x* is the complex 

30 conjugate of x. MX and its decisioning metric DX select the x 
which is closest to y as the MX choice for x. In the disclosure 
of this invention it will be demonstrated that the MX decisioning 
metric DX can be used to make the bit decisions in turbo decoding 

20 



and can be used to select the best trellis paths in convolutional 
decoding. 

Without any mathematical analysis, it should be apparent 
5 that DX has less noise compared to DM since DX is linear in y 
whereas DM involves the square of the vector y. This lower 
noise level translates into an improved decisioning performance 
of DX compared to DM. 

10 

BRIEF DESCRIPTION OF THE DRAWINGS 
AND THE PERFORMANCE DATA 

15 The above-mentioned and other features, objects, design 

algorithms, and performance advantages of the present invention 
will become more apparent from the detailed description set forth 
below when taken in conjunction with the drawings wherein like 
reference characters and numerals denote like elements, and in 

20 which: 

FIG. 1 is a representative block diagram of the 
implementation of a turbo encoder using a parallel architecture. 
# 

25 

FIG. 2 is a representative implementation block diagram 
for the turbo encoder and the convolutional encoder transmitter. 

FIG. 3 is a representative block diagram of the 
30 implementation of a turbo decoder using a parallel architecture. 

FIG. 4 is a representative implementation block diagram 
for the turbo decoder and convolutional decoder receiver. 

21 



FIG. 5 plots the Monte Carlo simulation of the decisioning 
metric performance for the MX decisioning metric 
DX=ln[p(x|y)p(x|y) ] and the ML decisioning metric DM=ln [p (y I x) ] 
5 against the symbol y signal-to-noise power ratio S/N. 

FIG. 6 plots the improvement in S/N against the symbol y S/N 
which improvement is the advantage in S/N from using the MX 
decisioning metric. 

10 

FIG. 7 is a representative block diagram of a convolutional 
encoder. 

FIG. 8 is a representative block diagram of a convolutional 
15 decoder. 

DISCLOSURE OF THE INVENTION 

20 

The invention provides new decisioning metrics and new 
probabilities and new equations for the turbo decoding and 
convolutional decoding, which together provide performance 
improvements and reduce the decoder implementation complexities 
25 for all decoding architectures. In this invention disclosure, the 
new decisioning metric will be derived and evaluated prior to the 
derivation of the new probability equations and algorithm 
examples for the new decoding architectures for turbo and 
convolutional codes . 

30 

The MX a-posteriori probability p(x|y) defines the 
decisioning metric DX for turbo and convolutional decodingwherein 
the DX is derived from the MX in equations (11) . Step 1 uses the 
Bayes rule to derive MX p(x|y) 
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MX decisioning metric DX 

1 Bayes rule p (a,b) =p (a I b) p (b) =p (b I a) p (a) 

enables MX probability p(x|y) to be defined 



(11) 
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p(x|y) = p(y|x)p(x)p(y) 

2 ML probability p(y|x) is 

p(y|x) = ( (2n) 1/2 a)- 1 exp(-|y-x| 2 /2a 2 ) 

3 Gaussian probability p(y) is 

15 p(y) = ((27t) 1/2 a)- 1 exp(-|y| 2 /2o 2 ) 

4. Equations 2,3 yield the result for MX 

p(x|y) = p(x) exp(Re(yx*) At 2 -|x| 2 /2c 2 )/(2ti) 1/2 o 

20 

5 Taking the natural log 
yields DX 

DX = ln[ p(x|y) ] 
25 = Re(yx*) /a 2 -|x| 2 /2a 2 + p_(x) 

= Re(yx*) /a 2 -|x| 2 /2a 2 + p(d) 

wherein 

x* = complex conjugate of x 
p(d) = p(x) since the symbol d 
30 corresponds to x 

p_(d) = ln[p(d)] 
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from the ML p(y|x) and the p(y), p(x). Step 2 is the the ML 
p(y|x) as in 1 in equations (1) . Step 3 defines p(y) as the 
Gaussian probability function. Step 4 derives the MX p(x|y) 
using the p(y|x) in 2 and dividing by the p(y) in 3. Step 5 
5 takes the natural log of the MX a-posteriori probability in step 
4 to derive the DX and wherein the a-priori probability p(d) of 
data word d is equal to the a-priori p(x) of the corresponding 
data symbol since x amplitude and phase encodes d. 

10 FIG. 5 plots the Monte Carlo simulation decisiohing 

performance 39 of the MX decisioning metric DX=ln[p(x|y) ] 41 and 
the ML decisioning matric DM=ln [p (y I x) ] 42 against the symbol y 
signal-to-noise power ratio S/N 40. . Equation DM=ln (p{y |x) ] 
assumes the additive constant is deleted. Decisioning metric 

15 performance 39 in the log domain is the difference between the 
correct and incorrect BPSK assumption for x. For the MX DX, the 
simulated performance metric is equal to In [<p (x | y) >/<p (x' | y) >] 
where <(o)> is the Monte Carlo statistical average over 100K 
trials of (o) , the p(x|y) is the correct decision for BPSK 

20 modulation, and po(x' |y) is the incorrect decision. A-priori 
probabilities of x,x' are equal which means p (x) =p (x' ) =1/2 so 
that the p(x)=p(x') cancels out in the DX metric. The 
performance metric , for the ML DM is the same 

ln[<p(y|x}/p(y|x' )>. It is apparent from the data 41,42 that the 

25 required S/N to support a given level for the DX metric is 
considerably less than required for the DM metric. This directly 
translates into an improved BER performance. 

FIG. 6 plots the improvement in S/N 43 against the symbol y 
30 S/N 44 This improvement 45 in S/N from using the MX 
decisioning metric in FIG. 5 compared to the current ML, is the 
increase in S/N required for the ML metric to equal the value 
measured for the MX metric. Over the range of S/N of interest 
which is 0 to 10 dB, there is a -1.7 dB improvement in S/N which 
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is significant and clearly translates into an improvement in BER. 
There are no other available means to offer this improvement for 
both turbo and convolutional decoding. 

The new a-posteriori probability density p(s,s'|y) for MAP 
is written as a function of the independent observations {y(j<k), 
y(k), y(j>k)} in equations (12) using 1,2 in equations (2). 

New MAP a-posteriori probability (12) 
P(s,s'|y) =p(s,s'| y(j<k), y(k) y(j>k) ) 

Recursive equation for p(s,s'|y) is derived in equations 
(13) following the steps in equations (3) for the p(s,s',y) 
recursive equations. Step 1 is the application of Bayes rule to 
partition the probability p(s,s'|y)- Step 2 takes advantage of 
the assumption that the channel is memoryless to simplify the 

Recursive formulation of p(s,s'|y) (13) 

1 Bayes rule p (a, b) =p (a I b) p (b) can be used to 
rewrite the p(s,s'|y) in equation (12) 

P(s,s'|y) =p(s,s'| y(j<k),y(k),y(j>k)) 
= p(s|s',y(j<k),y(k),y(j>k)) 
*p(s' ly(j<k),y(k),y(j>k)) 
where is a multiply operation 

2 Assuming the channel is memoryless 

P(s,s'|y) = p(s|s',y(k),y(j>k)) p(s'|y(j<k) 

3 The events { s' , y (k) } , {y ( j>k) } are independent 
since the channel is memoryless so 2 can be 
factored 

p(s,s' |y)=p(s|s' ,y(k))p(s|y(j>k) )p(s' |y(j<k) ) 
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4 This equation can be rewritten as a function of the 
a-posteriori recursive estimators and a-posteriori 
state transition probability 
5 p(s,s' ,y)= p k (s I s' ) b k (s) a k -i(s') 

wherin by definition 

p k (s|s') = p(s|s',y(k)) 
b k (s) = p(s|y(j>k)) 
10 a k -!(s') = p(s' |y(j<k)) 

partitioning in step 1. Step 3 applies the identity 

p(a|b,c)=p(a|b)p(a|c) which is true when events b,c are 

15 independent p (b, c) =p (b) p (c) , to re-partition the first factor 
into the product of two factors. Step 4 transforms the joint 
probability in step 3 derived as a product of three 
probabilities , into the equivalent product of the two new state 
estimators a k _i (s' ) ,b k (s) and the state transition probability 

20 Pk(sls') for the new MAP turbo decoding algorithm. The p k (s|s') 
calculates p(s|s',y(k)) for each state transition assumption 
s->s' for symbol set k. 

These a-posteriori estimators a k (s), b k (s), p k (s|s')/ are 
25 part of this invention disclosure and are clearly distinct from 
the current set of ML estimators a k i (s' ) , p k (s) , y k (s,s') in 4 in 
equations (3) . 

Forward recursive equation for a k (s) is derived in equations 
30 (14) as a forward recursion which is a function of the p k (s|s') 
and the previous state estimate a k -i(s'). Step 1 starts with the 
definition of a k (s) which is derived from the equation for 
a k -i(s') in 4 in equations (13). Step 2 introduces the state s' by 
observing the probability summed over all values of s' is equal 
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to the probability with s' excluded. Step 3 applies Bayes rule to 
partition the probabilities. In step 4 the assumption that the 
channel is memoryless enables the equation to be simplified to 
the form used in the MAP algorithm. In step 5, 



Forward recursive equation for a k (s) (14) 

1 From the definition for a k _i(s') in 4 in equations 
(13) we find 

a k (s) = p(s|y(j<k) ,y(k)) 

2 This probability can be written as the sum of 
joint probabilities over all possible states of s' 

a k (s) = Zaii s- P(s,s' |y (j<k) ,y (k) ) 

3 Applying Bayes rule 

a k (s) = Zaii s- p(s|s',y(j<k),y(k)) p(s' ly(j<k) , y (k) ) 

4 Applying the channel memoryless assumption 

a k (s) = Za 11S ' P(s|s',y(k)) p(s'|y(j<k)) 

5 Substituting the definitions of p k (s | s' , y (k) ) and 
a k -i(s') from 4 in equations (13) 

a k (s) = Zaii S ' Pk(sls') a k -i(s') 



substitution of p k (s I s' ,p (k) ) and a k _i(s') from 4 in equations 
(13) gives the final form for the recursive equation for a k (s) . 

Backward recursive equation for b k - 1 (s / ) is derived as a 
backward recursion in equations (15) as a function of the 
p k (s' | s) =p (s' Is) and the previous estimate b k (s), following the 
steps in equations (14). Step 1 derives b k -i(s') from the 
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equation for b k (s) in 4 in equations (13). Step 2 is similar to 
steps 2,3,4 in equations (14). In step 3 , using the equality 



5 Backward recursion equation for b k -i(s') (15) 

1 The definition for b k (s) from 4 in equations (13) 

b k -i(s' ) = p(s' |y(j>k-l) 

2 Similar to the steps 2,3,4 in equations (4), we find 
10 b k - x (s') = Sans p(s|y(j>k) )p(s' |s,y(k)) 

3 Substituting the definitions of b k (s) from 4 
in equations (13) 

b k -i(s') =Zaiisb k (s) p k (s'|s) 

15 



p(s' |s,y(k) )=p(s|s' , y(k) which is equivalent to the equality 
p k ( S '| S )= Pk ( S |s') and substitution of p k (s|s') from 4 in 
20 equations (13) gives the final form for the recursive equation 
for bfc-i(s'). The equality p k (s'|s) = p(s|s') simply recognizes 
that they are defined by the same MX equations as well as the 
same decisioning metric DX. 

25 Log of the state transition probabilities p k ( s | s ' ) =p k ( s ' | s ) 

are derived in equations (16). The p k (s|s') is the probability 
of the decoder trellis state S(k-l)=s' transitioning to the next 
state S(k)=s given the observation y(k). For the backward 
recursion, the p k (s'|s) is the probability of the decoder 

30 trellis state S(k)=s transitioning from the previous state S(k- 
l)=s' given the observation y(k). In step 1 we rewrite the 
definition of p k (s|s') in 4 in equations (13) as the probability 
of the state transition s'->s given the observation y(k) . Step 2 
rewrites 1 as the equivalent probability of the transmitted 
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symbol x(k) corresponding to the transition s'->s. Step 3 are 
definitions similar to 2 in equations (6). Step 4 expands the 
equations in 2 into a product over the codeword bits for the #1 
and #2 encoders 3 and 5 respectively in FIG. 1, of the 



State transition probabilities p k (s|s')= Pk(s'ls) (16) 

1 The Pk(s|s') is defined in 4 in equations (13) 

Pk(sls') = p(s|s',y(k)) 
= p(s'-»s|y(k) ) 

2 Since the transition s'->s is defined by x(k) 

Pk(sls') = p(x(k) |y(k)) 

Definitions 2 in equations (6) have the properties 
d(k) = input data corresponding to x(k) * 
p(d(k)) = p(x(kj), = a-priori probability of d(k) 
x(k) = {x(k,b)), b refers to the codeword bits 
y(k) = {y(k,b)} # b refers to the codeword bits 

4 These definitions and the memoryless assumption, enable 
equations 2 to be expanded 

p k (s|s') = p(x(k) lyfk) } 

= lib p(x(k,b) ly(k,b)) 

5 Using 4 in equations (11) 

enables this equation to be rewritten 

Pk(s|s')= Tib [ (2n) 1/2 a)" 1 exp(DX(k,b) ) p(d(k) ) 
- Pk(s' Is) 

6 MX decision metrics are 
from 6 in equations (11) 

DX = DX(s|s' ) 
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= Z b DX(k,b) 

= 2 b Re[y(k / b)x*(k f b)]/a 2 -|x(k f b) | 2 /2o 2 + £ (d(k)) 
= DX(s' |s) 

5 7 Log equations for £ k (s I s' ) =p k (s' I s) are the log of 5 

using 6 

£k (s|s') = DX(s|s / ) 
= DX (s' |s) 
= p k (s' Is) 

10 

probabilities for each bit p (x (k,b) | y (k,b) ) . Step 5 introduces 
the standard turbo code assumption that the channel is Gaussian 
and uses BPSK (Binary phase shift keying) symbols which means 
15 d(k)=+/-l identical to the starting assumptions for equations 
(11) , with a equal to the one sigma Gaussian noise along the 
inphase and quadrature axes. 

Step 6 generalizes the MX decisioning metric DX in 6 in 
20 equations (11) for p (x | y) =p (x | y) , to DX(k,b) for 
p(x(k,b) |y(k,b))=f (x(k,b) ly(k,b)), and to DX (s I s' ) =DX (s' I s) equal 
to the sum of the DX(k,b) over all s-»s' and s'->s transitions 
respectively, which is the sum over all bits {b} for clock k 
equal to codeword k. Step 7 takes the log of 5 and deletes the 
25 additive constants to give the log equations for the state 
transition probabilities p k ( s I s ' ) =£ k ( s ' Is) as linear sums of the 
DX(s|s' ) ,DX(s' |s) and the log of the a-priori data probability 
£>(d(k)). The p k (s | s r ) = p k (s # I s) will be used in turbo decoding 
algorithms, and in convolutional decoding algorithms when the log 
30 a-priori probability £(d(k)) is deleted. 

Log equations for a k (s), b k -i(s') are derived in equations 
(17) from equations (14), (15) respectively for a k (s), b k -i(s') 
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using the definition of £ k (s|s') in 7 in equations (16). Step 1 
gives the log equation for a k (s) by taking the log of the a k (s) 
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Log equations for the a-posteriori 

metrics a k (s), b k -i(s') (17) 

1 Log, a k (s) , of a k (s) 

a k (s) = In [ Zaii s'exp (a k -i (s' ) +DX (s Is'))] 

2 Log, bfc-i(s'), of b k .i(s') 
b w (s')«ln[ Zaiisexp (b k (s) +DX (s' I s) ) ] 



15 equation in 5 in equations (14) and using the definition of 
£ k (s|s') in 7 in equations (16). Step 2 takes the log of the 
equation for b k _i(s') in 3 in equations (15) to derive the log 
equation for bk-i(s') and uses the definition for £ k (s|s') in 7 in 
equations (16). 

20 

The new MAP equations for the log likelihood ratio 
L(d(k)|y)) are derived in equations (18). Step 1 is the definiton 
from references [1],[2]. Step 2 replaces p(d(k)) with the 
equivalent sum of the probabilities that the transition from 
25 S(k-l)=s' to S(k)=s occurs and which are the new probabilities 
p(s,s' |y) over these transitions. Step 3 substitutes the log 
of the recursive estimators a k -i (s' ) , b k (s) , from 1,2 in 
equations (17) and the £ k (s|s') from 7 in equations (16). Step 4 
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The new MAP equations (18) 
1 Definition 

L(d(k)) |y) = ln[p(d(k)=+l|y) ] 
-ln[p(d(k)=-l|y) ] 
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2 Probability of p(d(k)) is the sum of the probabilities 
that the state S(k-l)=s/ transitions to S(k)=s 

L(d(k))|y) = ln[ Z (s ,s'id<k)« + i) p(s,s'|y)l 
-ln[ 2 ( s,s'id<k)-i) p(s, s' |y) ] 

3 The new MAP equation is obtained by substituting the 
a k -i(s' ) ,b k (s) , £ k (s|s' ) 

L(d(k))|y) = ln[ E {s , sM d<k)= + i) p(s,s'|y)] 
-ln[ E (s ,s'id<k)=-i) p(s r s' |y) ] 

= ln[E (s , sMd(k ,- + i, exp(a k -i(s' )+DX(s|s' )+b k (s) ) ] 
-ln[E (s , sMd{k) -i, exp(a k -i(s' )+DX(s|s' )+b k (s) ) ] 

3 Hard decisioning rule 

d(k) - +1/-1 when L(d(k)|y) > 0 / < 0 

5 Soft decision metric = L(d(k))Jy) 



gives the hard decisioning rule. Step 5 identifies L(d(k) |y) to 
be the soft decisioning metric. 

FIG. 1 describing a representative turbo encoding block 
diagram for a parallel architecture and FIG. 2 describing a 
representative implementation block diagram of a turbo encoder 
and transmitterapply to the invention. 

Fig. 3 describing a representative turbo decoding block 
diagram and FIG. 4 describing a representative receiver block 
diagram for a turbo decoder receiver, apply to the invention 
when the turbo decoding signal flow diagram in FIG. 3 implements 
the MAP iterative algorithm in equations (9) using the likelihood 
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ratios in equations (18) . The decisioning metric performance 
advantage of -1.7 dB in FIG. 5,6 will support a BER improvement 
in the MAP algorithm (9) . 



5 Convolutional decoding starts with the assumption of a 

sequence of observed channel output symbols {y(k), k=l,2,...,N} of 
the receiver where "k" is' the running index over the N 
transmitted symbols. Each set y(k) of symbols at clock k 
consists of the observed uncoded and coded symbols for the 
10 received codeword k at clock k. These are the same starting set 
of assumptions used for turbo decoding. 

FIG. 7 is a representative convolutional encoder block 
diagram. Input 46 to the encoder are the user data bits {d(k)} 

15 for k=l,2,. . . ,N. The encoder for a convolutional code uses a 
recursive systematic code RSC or a systematic code SC which means 
the first codeword bit 47 is the user data bit called systematic 
bit, or bits, which are uncoded. These user data bits {d(k)} 
are also handed over to the encoder 48 followed by interleaving 

20 49. Output bits 50 are punctured to obtain the correct code 
rate and multiplexed 51 into a continuous output bit stream 52 of 

codewords {c(k)} for each of the codeword clocks k=l,2, Each 

codeword c(k) 52 is a set of bits consisting of the systematic 
bits followed by the encoder and interleaver output bits 52. 

25 

FIG. 8 is a representative convolutional decoder block 
diagram. Inputs are the detected soft output symbols 53 from 
the received channel demodulator which detects and recovers these 
symbols. This stream of output symbols consists of the outputs 
30 for the systematic bit b=l and the outputs from the interleaved 
and encoded bits. Following de-interleaving 54 the convolutional 

decoder recovers estimates {d(k)} of the user input bits {d(k)} 
to the convolutional encoder. 
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Convolutional decoding similar to the Viterbi algorithm, 
solves the recursive equations [Ref. 2,3,5] derived from 
equations (7) by replacing the summations over all possible 
transitions with the best transition path to each of the new 
5 trellis states. The best transition path for convolutional 
decoding is the best choice of s' for each forward path s'->s and 
the best choice of s for each backward path s->s' , where best is 
the maximum value of the state metric for the path transitions. 

10 For the forward recursion the log ML equations are derived 

in equations (19) using the redefined state path metric a k (s) 
and the state transition decisioning function DM. Step 1 is the 

15 Forward equations for ML convolutional decoding (19) 
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The ML probability density has the well-known 
factorization assuming a memoryless channel 
p(y(k)|s) = rij-i,_,fc-i P(y(j) ISj-i ->Sj) 

- p(y(k) |s'-»s) p(y(k-l) Is') 



20 



2 



State path metric a k (s) in log format is 
fflc(s) = £(y (k) is) 



3 



Forward equations for a k (s) are derived using 2 
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and the log of 1 to yield 

a k (s) = max [j> (y (k-1) I s' ) + £(y (k) | s' ->s) ] 



max [a k -i(s' ) + DM(s | s' ) ] 



DM(s|s' ) 



E (y(k) |s'-»s)] 
-|y(k)-x(k) | 2 /2a 2 
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factorization of the ML probability that is allowed by the 
memoryless channel assumption. Step 2 is the definition of the 
path metric . a k (s) in log format which is different from its 
definition in 1 in equations (4) for MAP turbo decoding. Step 3 
derives the forward recursive equation for a k (s) by combining the 
equations in 1 and 2 and using the definition of the ML 
decisioning metric DM=ln [p (y (k) | s' ->s) ] = p (y (k) | s' ->s) ] for the 
path s'->s for convolutional decoding. Path metrics and the 
corresponding data d(k) bit for each trellis state are stored in 
a state matrix. The best path corresponding to decoding state k 
is used to select the best data d(k-D) bit decision at the state 
k-D of this path stored in the state matrix, where D is a delay 
in the data bit decisioning that is required for reliable 
decoding. 

For the backward recursion the log ML equations are derived 
in equations (20) using the state path metric J3 k (s) in 2 in 
equations (7), and the state transition probability 3fe(s,s') and 
decisioning metric DM (sis') from 4,5,6 in equations (6). Step 1 

Backward equations for ML convolutional decoding (20) 

1 State path metric g k -i(s') in log format is equal 
to the value 1 in equation (5) 

fik-ifs') = ln[p(y(j>k-l),s')] 

= p(y(j>k-l) Is' ) ] 

2 Backward equations for 0 k -i(s') are derived using 1 
and the 2,3 in equations (5) to yield 

fik-i(s') = max [£(y(j>k) Is) + £(s, y (k) Is')] 

s 

= max [fi k (s) + DM(s|s' ) ] 

s 

DM(s'ls) = -|y(k)-x(k) IV20 2 
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is the definition of J3 k -i(s') in 1 in equations (5). Step 2 
modifies the derivation of J3 k -i(s') in equations (5) and the final 
equation for J3 k -i(s') in 2 in equations (7) to derive the g k _!(s') 
5 for the backward convolutional decoding, with the modifications 
being 1) setting the a-priori probability £(d(k)=0 since there 
is no a-priori probability available, and 2) replacing the 
summation over all s with the maximum with respect to s of []3 k (s) 
+ DM(sls')].- Path metrics and the corresponding data d(k) bit for 
10 each trellis state are stored in a state matrix. The best path 
corresponding to decoding state k is used to select the best data 
d(k+D) bit decision at the state k+D of this path stored in the 
state matrix, where D is a delay in the data bit decisioning 
that is required for reliable decoding. 

15 

The new convolutional decoding equations (21) for forward 
and backward recursions are modifications of the previously 
derived MAP equations for a k (s) in equations (14), b k _i(s') in 
equations (15), DX (s I s' ) =DX (s' I s) in equations (16), and the 

20 final equations for a k (s), b k -i(s') in 1,2 in equations (17). 
Modifications consist of 1) setting p(d(kj)=0 since there is no 
a-priori information on p(d(k)), and 2) replacing the summation 
over all s',s with the maximum of [a k _i (s' ) +DX (s I s' ) ] , 
[b k (s)+DX(s' |s) ] respectively with respect to the path transition 

25 s'->s,s->s' respectively. 

The new a-posteriori convolutional decoding 

equations (21) 

30 1 Definition of a k (s) from 1 in equations (14) 

a k (s) = £(s|y(j<k) 

2 Forward recursion for a k (s) can be derived by 
modifying the derivation of a k (s) for the MAP 
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turbo decoding to yield 



a k (s) = max tacts' )+ DX(s|s')] 



DX(s|s')] = Re[y(k)x*(k)]/a 2 -|x(k) 1 2 /2a 2 +£ (d (k) ) 



5 



3 Definition of b k -i(s') from 1 in equations (15) 
b k -i(s') = p(s' |y(j>k-D) 



10 



4 



Backward recursion for b k -i(s') can be derived by 
modifying the derivation of b k -i(s') for the MAP 
turbo decoding to yield 



b k -i(s' ) 



max [b k (s)+ DX(s' |s) ] 



DX(S' |s)] 



Re[y(k)x*(k)]/a 2 -|x(k) 1 2 /2a 2 +p (d (k) ) 
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Step 1 for the new forward recursion uses the same 
definition of a k (s) for the MAP turbo decoding in 1 in equations 
(14) . . Step 2 then follows the steps in equations (14) , (16) 

20 leading to the equations 1 in equations (17) for a k (s) for the 
MAP turbo decoding, upon replacing the summation over s' with the 
maximization with respect to s' similar to the derivation of the 
forward recursion equations for a k (s) in (19). Path metrics and 
the corresponding data d(k) bit for each trellis state are stored 

25 in a state matrix. The best path corresponding to decoding state 
k is used to select the best data d(k-D) bit decision at the 
state k-D of this path stored in the state matrix, where D is a 
delay in the data bit decisioning that is required for reliable 
decoding. 



Step 3 for the new backward recursion uses the same 
definition of b k -i(s') for the MAP turbo decoding in 1 in 
equations (15) with the modification that the a-priori 
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probability £ (x (k) ) =£ (d (k) ) =0 corresponding to setting the 
probability p (d(k) =1) =p (d (k) =-1) =1/2 . Step 4 then follows the 
steps in equations (15) ,(16) leading to the equations 2 in 
equations (17) for b k _i(s') for the MAP turbo decoding, upon 
replacing the summation over s with the maximization with respect 
to s similar to the derivation of the backward recursion 
equations for J3 k -i(s') in (20). Path metrics and the corresponding 
data d(k) bit for each trellis state are stored in a state 
matrix. The best path corresponding to decoding state k is used 
to select the best data d(k+D) bit decision at the state k+D of 
this path stored in the state matrix, where D is a delay in the 
data bit decisioning that is required for reliable decoding. 

Preferred embodiments in the previous description of the 
probabilities, decisioning metrics, algorithms, and 
implementations, are provided to enable any person skilled in 
the art to make or use the present invention. The various 
modifications to these embodiments will be readily apparent to 
those skilled in the art, and the generic principles defined 
herein may be applied to other embodiments without the use of the 
inventive faculty. Thus, the present invention is not intended 
to be limited to the embodiments shown herein but is intended to 
be accorded the wider scope consistent with the principles and 
novel features disclosed herein. 

It should be obvious to anyone skilled in the 
communications art that these example probabilities, decisioning 
metrics, algorithms, and implementations, define the 

fundamental architecture and signal processing relevant to this 
invention disclosure and it is obvious that this example is 
representative of the other possible signal processing 
approaches. 
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For cellular applications the receiver description in FIG. 
4 includes the new turbo decoding and the new convolutional 
decoding and describes the corresponding receiving signal 
processing for the cellular hub and user. 

For optical communications applications the microwave 
processing at the front end of both ' the transmitter and the 
receiver is replaced by the optical processing which performs the 
complex modulation for the optical laser transmission in the 
transmitter and which performs the optical laser receiving 
function of the microwave processing to recover the complex 
baseband received signal. 
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